Scaling prediction errors to reward variability benefits error - driven learning in humans 1 Running title : Reward prediction error scaling correlates with learning efficiency
نویسنده
چکیده
4 1 Department of Physiology, Development, and Neuroscience, University of Cambridge, Cambridge 5 CB2 3DY, United Kingdom 6 7 * Correspondence should be addressed to Kelly M.J. Diederen, Department of Physiology, 8 Development, and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, 9 UK. E-mail: [email protected], Tel: + 44 (0)1223 333754, Fax: + 44 (0)1223 333840 10 11 Author contributions: Kelly M.J. Diederen and Wolfram Schultz designed the experiment, interpreted 12 the data, wrote the manuscript and approved the final version of the manuscript. Kelly M.J. Diederen 13 performed the experiments, analyzed the data and prepared the figures. 14 15 Number of tables: 3 16 Number of figures: 4 17 Number of words abstract: 173 18 Number of words introduction: 576 19 Number of words discussion: 1755 20 21
منابع مشابه
Scaling prediction errors to reward variability benefits error-driven learning in humans
Effective error-driven learning requires individuals to adapt learning to environmental reward variability. The adaptive mechanism may involve decays in learning rate across subsequent trials, as shown previously, and rescaling of reward prediction errors. The present study investigated the influence of prediction error scaling and, in particular, the consequences for learning performance. Part...
متن کاملAdaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After ...
متن کاملBOLD Responses to Negative Reward Prediction Errors in Human Habenula
Although positive reward prediction error, a key element in learning that is signaled by dopamine cells, has been extensively studied, little is known about negative reward prediction errors in humans. Detailed animal electrophysiology shows that the habenula, an integrative region involved in many processes including learning, reproduction, and stress responses, also encodes negative reward-re...
متن کاملReward expectation and prediction error in human medial frontal cortex: An EEG study
The mammalian medial frontal cortex (MFC) is involved in reward-based decision making. In particular, in nonhuman primates this area constructs expectations about upcoming rewards, given an environmental state or a choice planned by the animal. At the same time, in both humans and nonhuman primates, the MFC computes the difference between such predictions and actual environmental outcomes (rewa...
متن کاملPanel Session What Does Dopamine Say: Clues from Computational Modeling
Background: Reinforcement learning models now play a central role in modern attempts to understand how the brain categorizes and values events traditionally framed by psychology as rewards and punishments. These models provide a way to design and interpret of reward expectancy experiments in humans across a wide range of rewarding dimensions. They also provide a connection to computational mode...
متن کامل